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^ (57) Abstract: A camera system and method for operating that system. The camera system comprises a stationary camera having 
— , a wide angle view, a remotely controllable camera having a relatively smaller angle view for providing images in substantially foil 
2 resolution, and a processor. The processor monitors the wide angle view of the stationary camera, receives information concerning 

a selected desired subject within the wide angle view, generates an electronic pan- tilt-zoom view of the selected desired subject 
^ based on the wide angle view of the stationary camera, controls the remotely controllable camera for providing a view that overlaps 

the electronic pan-tilt-zoom view of the desired subject, and processes the electronic pan -tj lt-zoom view of the desired subject in 
^ accordance with the resolution of the remotely controllable camera. 
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Camera system and method for operating same 



BACKGROUND OF THE INVENTION 
Field Of The Invention 

The present invention generally relates to a camera system and a method for 
operating same. 

5 , . ., . . . ... ... " ' 

Description of Prior Art 

In a conventional mechanical pan/tilt/zoom camera system, when a new region 
of interest is identified, a computer moves the manual camera to view that region and 
controls the zoom function of the camera in order to frame the hew region of interest. On the 
10 other hand, conventional eli^trbnifc-pah-tilt-zoom ("EPTZ*) cameras remain stationary, but 
the region of interest is culled from the overall image and scaled to fit the display window. 
Furthermore, the resolution of the image of the EPTZ camera is significantly reduced when 
attempting to upscale a small region of interest to a relatively larger display. Although 
MPTZ cameras can provide a full resolution view of the desired region of interest, MPTZ 
1 5 cameras cannot immediately move to the next shot 

It is therefore an object of the present invention to provide a camera system 
that provides for instant switching between the view provided by an EPTZ camera and the 
view provided by ari MPTZ camera. 

Other objects and advantages of the present invention will be apparent to one 
20 of ordinary skill in the art in light of the ensuing description of the present invention. 

SUMMARY OF THE INVENTION • 

In one aspect, the present invention is directed to a camera system that 
comprises a stationary camera having a wide angle view, a remotely controllable camera 
25 having a relatively smaller angle view for providing images in substantially full resolution, 
and a processor. The processor monitors the wide angle view of the stationary camera, 
receives information concerning a selected desired subject within the wide angle view, 
generates an electronic pan-tilt-zoom view of the selected desired subject based on the wide 
angle view of the stationary camera, controls the remotely controllable camera for providing 
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a view that overlaps the electronic pan-tilt-zoom view of the desired subject* and processes 
the electronic pan-tilt-zoom view of the desii^ subject in accordance with the resolution of 
the remotely controllable camera. 

In an alternate embodiment, the camera system of the present invention does 

5 not effect generation of data defining the desired subject; Instead, the view of the desired 
' subject within the wide angle view is created by a user interface whereby the user manually 
selects the desired subject. 

In another aspect, the present invention is directed to a method of operating a 
camera system comprising the steps of providing a camera system having a stationary camera 

10 providing a wide angle view and a remotely controllable camera set having a relatively 

smaller angle view for providing images in substantially full resolution, monitoring the wide 
angle view of the stationary camera, selecting a desired subject within the wide angle view, 
generating an electronic pan-tilt-zoom view of the desired subject based on the wide angle 
view of the stationary camera, controlling the remotely controllable camera for providing a 

15 view that overlaps the electronic pan-tilt-zoom view of the desired subject, and processing 
the electronic pan-tilt-zooiri view of the desired subject in accordance with the resolution of 
the remotely controllable camera. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 The features of the invention are believed to be novel and the elements 

characteristic 6f the invention are set forth with particularity in the appended claims. The 
invention itself, both as to organization and method of operation,.may best be understood by 
reference to the detailed description which follows taken iri conjunction with the 
accompanying drawings in: which: 

25 FIGS. 1 and 2 are block diagrams illustrating the operation of the camera 

system of the present invention. / . 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to FIG. 1, camera system 10 of the present invention generally 
30 comprises stationary camera 12; remotely controllable camera 14 and programmable 

processor 16. In one embodiment, stationary camera 12 comprises an electronic-pan-tilt- 
zoom ("EPTZ") camera. In one embodiment, camera 14 comprises a mechanical-pan-tilt- 
zoom ("MPTZ") camera. Cameras 12 and 14 are controlled by processor 16. Specifically, 
processor 16 issues commands that can cause camera 12 to electronically pan, tilt, zoom and 
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. focus as well as other camera functions. Remotely controllable camera 14 comprises motors 
(not showii) which ieffect pan, tilt, zoom and focus functions. The aforementioned motors are 
controlled by control signals outputted by processor 16. In one embodiment, processor 16 
comprises a computer; One such computer is described in U.S. Patent No; 5,434,61 7, the 
5 disclosure of which is incorporated herein by reference. Stationary camera 12 is configured 
to provide wide angle view 18; Remotely controlled camera 14 is configured to provide a 
relatively smaller angle view 20. The configuration of camera 1 4 allows for a relatively high 
and full resolution of a desired subject or region of interest. 

Referred to FIGS, l and 2, processor 16 monitors wideangleyiew 18 of 

1 0 stationary camera 1 2. Processor 1 6 generates pixel data defining a frame containing overall 
subject area 21 that is within wide angle view 18. Processor 16 also generates data defining 
the location of desired subject (or region of interest) 22 that is part of subject area 2 1 and 
within wide angle view 18. In one embodiment of the present invention* the pixel data 
defining desired subject or region of interest 22 is inputted into processor 16. Processor 16 

15 then outputs an EPTZ view to display device 24. Processor 1 6 then controls remotely 
controllable camera 1 4 in accordance with the generated pixel data in such a manner that 
view 20 provided overlaps the portion of wide angle view 1 8 that contains desired subject 22 
(see FIG. 2). Specifically, processor 16 controls the motors (not shown) of camera 14 so as 
to move camera 14 in such a manner that view 20 of camera 14 overlaps at least a portion of 

20 wide angle view 18 such that desired subject 22 is within view 20. Processor 16 then 

generates pixel data, based upon view 20, defining desired subject 22. Since camera 14 has 
the capability to provide a smaller, but relatively higher resolution view of desired subjects, 
the resulting view of desired subject 22 is displayed on a display device 24 with a relatively 
higher or fuller resolution. Once desired subject 22 is displayed on display device 24, camera 

25 12 can then be controlled to provide a wide angle of view of a new subject area (not shown). 

In an alternate embodiment, camera system 1 0 does not effect generation of 
data defining the desired subject. Instead, the view of the desired subject within the wide 
angle view is created by a user interface whereby the user manually selects the desired 
subject. In such an alternate embodiment, camera system 10 further includes a user interface 

30 (not shown) in electronic data communication with processor 1 6 and an additional display 
device (not shown) that constantly provides the user with the view of camera 12. 

In a preferred embodiment, processor 1 6 is programmed with software that 
realizes well known optical flow techniques that are typically used in computer vision 
systems. These optical flow techniques allow camera system 10 to align the views from the 



WO 02/062056 PCIYIBO 1/02695 

4 

stationary camera 12 and mechanical camera 14. In a preferred embodiment, processor 16 
includes means for receiving calibration data that defines particular operational 
characteristics of stationary and remotely controlled cameras 12 and 14. 

Each step of the method of the present invention is explained in the ensuing 
5 description with reference to FIGS. 1 and 2. 

In the first step of the method of the present invention, processor 16 monitors 
wide angle view 18 and generates angle view 1 g and generates pixel data that defines view 
18. 

Next, a desired subject (or region of interest) 22 within wide angle view 18 is 
10 selected for viewing with full resolution by processor 16. The image of view 18 is processed 
using existing and known EPTZ techniques to provide view 19 of the desired subject with 
relatively low resolution. View 19 is then sent to display device 24. 

Next, the pixel data outputted by camera 12 is inputted into processor 16. In 
response, processor 16 issues commands to camera 14 so as to cause view 20 to overlap view 
15 19 which contains desired subject 22. 

In the next step, processor 1 6 processes pixel data based upon view 20 and 
provides a full resolution view of desired subject 22. 

Next, the full resolution view of desired subject 22 is displayed to viewers via 
display device 24. After desired subject 22 is displayed on display device 24, camera 12 can 
20 then be controlled to provide a wide angle of view of a new subject area (not shown) and the 
foregoing steps are repeated. In the alternative, after desired subject 22 is displayed to 
viewers on display 24, a new desired subject (not shown) can be selected from overall subject 
area 21 and the foregoing steps repeated. 

A significant advantage of camera system 1 0 is that it provides for instant 
25 switching between shots, i.e. instant switching between a wide angle view to a full resolution 
view of a desired subject. Camera system 10 can be implemented with commercially 
available components. Furthermore, camera system 10 can be implemented at reasonable 
costs. 

The principals, preferred embodiments and modes of operation of the present 
30 invention have been described in the foregoing specification. The invention which is 

intended to be protected herein should not, however, be construed as limited to the particular 
forms disclosed, as these are to be regarded as illustrative rather than restrictive. Variations 
in changes may be made by those skilled in the art without departing from the spirit of the 
invention. Accordingly, the foregoing detailed description should be considered exemplary 
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in nature and not limited to the scope and spirit of the invention as set forth in the attached 
claims. ' : ■ •**•■- ■ " V 
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1 . A camera system (1 0), the system comprising: 

a stationary camera (12) having a Wide angle view; 

a remotely controllable camera (14) having a relatively smaller angle view for 
providing images in substantially full resolution; and 
5 a processor (16) for monitoring the wide angle view of the stationary camera 

(12), enabling selection of a desired subject within the wide angle view, generating an 
electronic pan-tilt-zoom view of the desired subject based on the wide angle view of the 
stationary camera, controlling the remotely controllable camera (14) for providing a view that 
overlaps the electronic pan-tilt-zoom view of the desired subject, and processing the 
1 0 electronic pan-tilt-zoom view of the desired subject in accordance with Ate resolution of the 
remotely controllable camera (14). 

2. The camera system according to claim 1 wherein the stationary camera (12) 
comprises a Hectronic-pM-tilt-z6om camera. 

15 

3. The camera system according to claim 1 w^ 
camera (14) cttiti^^ 

4. The camera system according to claim 1 wherein the processor (16) comprises 
20 a computer. 

5. The camera system according to claim 1 farther including means for 
displaying the substantially full resolution view of the desired subject. 

25 6. The camera system according to claim 1 wherein the processor (16) includes 

means for receiving calibration data that defines particular operational characteristics of the 
stationary and remotely controlled cameras. 



A method of operating a camera system, comprising the steps of: 
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providing a camera system (10) having a stationary camera (12) providing a 
wide angle view and a remotely controllable camera (14) having a relatively smaller angle 
view for providing images in substantially full resolution; 

monitoring the wide angle view of the stationary camiera (12); 
5 selecting a desired subject within the wide angle view; 

generating an electronic pan-tilt-zoom view of the desired subject based on the 
wide angle view of the stationary camera (12); 

controlling the remotely controllable camera (14) for providing a view that 
overlaps the electronic pan-tilt-zoom view of the desired subject; and 
10 processing the electronic pan-tilt-zoom view of the desired subject in 

accordance with the resolution of the remotely controllable camera (14). 

8. The method according to claim 7 further comprising the step of providing 
calibration data that defines particular operational characteristics of the stationary and 

15 remotely controllable cameras. 

9. The method according to claim 7 wherein the processing step further 
comprises the step of displaying the processed view of the desired subject 



20 



10. the method according to claim 7 wherein the selecting step comprises the step 

of generating pixel data defining the desired subject within the wide angle view. 
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